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SELF-GENERATED CONTENT WITH ENHANCED LOCATION INFORMATION 

BACKGROUND OF THE INVENTION 
The present invention generaUy relates to a method and system for providing 
additional infonnation for self-generated content, such as audio and visual content, and 
particularly relates to a mefliod and system for providing the self-generated content with 
additional data such as enhanced location infonnation. 

There aie systems that store self-generated content, such as self-generated image 
content from a camera, with additional data regarding a time and location of when and 
where the image content was acquired. For example, cameras, such as camcorders and 
digital cameras, are known that maintain a cunent time mdication. These cameras have the 
ability to store tiie time indication, at flie time of image acquisition, togetiier with the 
digital image data. Oflier cameras are known tiiat utilize a global positioning system 
(GPS) location indication, typically simple GPS coordmates. for purposes of storing the 
GPS coordinates that indicate a location of image acquisition togetiier with tiie image data. 

However, problems exist in that the GPS coordinates in many cases yields 
insufficient information to be useful or even meaningful to a user. Namely, the GPS 
coordmates must first be resolved into coordinates canymg more meaning, like a town or 
region where tiie image was acquired. This additional infonnation in many mstances may 
still not prove to be sufficiently infonnative since in many mstances. where a picture was 
acquired may later cany little meaning to die user. For example, during vacations many 
pictures are acquhed on day trips. A typical day trip may consist of starting at a town A 
and traveUng to a town B, then to a town C. and fliereafler, at tiie end of ttie day, travelmg 
to a town D. The information fliat an una^ was acquired at a location X carries far less 
meaning tiien, for example, the information tiiat flie image was acquired somewhere on tiie 
road from town B to town C. hi addition, in prior systems, location infonnation stored 
with the image data is determined and stored solely at tiie time of unage acquisition.' 
Oftentimes, it may not be tiU sometime after an image is acquired tiiat relevant location 
infonnation is determined, 

3 0 Accordingly, it is an object of tiie present invention to overcome tiie above 

disadvantages and other disadvantages of the prior art 
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SUMMARY OF THE INVENTION 
nie invention provides a system, such as a camera system, for acquiring self- 
generated content and detennining additional data related to the self-generated content, m 
accordance wilh one embodimeni, fte content acquiring device may have a content input, a 
datainpu,,andaptocessor. Tlic data input may be utilized for acquiring content, as weU 
as for acquiring a time of acquiring the content and/or a location of acquiring the content 
Tlie data input receives at least one of timeframe data and reference location data. The 
processor is operatively coupled to the content input and the data input and is utilized to 
determine additional data fiom a relation between at least one of the time of acquiring the 
content and the location of acquiring the content, and at least one of the timefiame data and 
the reference location data. 

The content acquiring device may be an imaging camem such as a photographic 
camera, a motion picture camera, or a camcorder. Hie content acquiring device may 
mclude a global position system receiver (GPS) coupled to the processor for providing the 
processor with the location of acquiring the content The content acquiring device may use 
both the timefiame data and the reference location data for determining the additional data 
Ihetnnefiamedatamaybeastartandanendofatimeinterval. The reference location 
data may be a location ofthe content acquiring device at fte start and the end of the time 
interval. 

The content acquiring device may also include a memory for storing the acquired 
content and the determmed additional data. Further, the data input ofthe content acquiring 
dev.ce may be a microphone for receiving audio input that is converted by the processor to 
the tmieftame data and/or the reference location data. Tb^ data input ofthe content 
acquiring device may also be connectable to an external network, such as the World Wide 
Web (WWW), or an external data source, such as a computer or an external storage device. 

DESCRIPTION OF THE DRAWINGS 

The following are descriptions of embodnnents ofthe present invention that when 
taken m conjunction with the following drawings will demonstrate the above noted 
features and advantages, as well ^ further ones. It should be expressly understood that the 
drawings and description are included for illustrative purposes and do not represent the 
scope of a present invention. The mvention is best understood in conjunction wifli the 
accompanying drawings in which: 



2 



NL021389 . '^'«^**--^2Si3:s «, jLejiaLcia 



HG. 1 shows an fflustrative embodiment of a system in accordance with an embodunent of 
the present invention; 

nG. 2 shows'a flow diagram illustrating operation of a system in accordance with an 
embodiment of the present invention; and 

FIG. 3 shows a portion 300 of the memory 126. for storing data related to an image that is 
acquired in accordance with the present inventi(ui. 

DESCRIPTION OF THE INVENTION 
FIG. 1 shows an illusttative system 100 in accordance with an embodiment of the 
present mvention including a content acquisition device, hereinafter generally referred to 
as a camera 120, having a content acquisition device, such as an hnaging system (not 
shown). The content acquisition device is operatively coupled to a processor 122. The 
operation of a content acquisition device for acquiring content, such as an imaging system 
of a digital camera for acquiring digital image content, is known in the art and will not be 
discussed further herein accept as may be necessary to further discuss Oe inventive aspects 
of the present invention. To fecilitate operation in accordance wiA an embodmient of the 
present invention, the processor 122 may be operatively coupled to a memory 126, an 
audio input, such as microphone 128.' and a coordinate resolving device, such as a GPS 
receiver 124. It shbuld be noted that each of these elements also might operate in 
accordance with known hnaging systems. For example, flie memory 1 26 may be utilized 
to store imaging content acquired by the camera 120 and resolved by the processor 122 as 
is known in flie art 

In accordance with an embodiment of the present invention, the camera 120 may 
also have a data input 1 10. The data mput 1 10 is Ulustratively shown coupled to an 
Internet connection 130 for operatively couplmg the camera 120 to data servers via the 
World Wide Web (WWW...). TTie data mput 1 10 is also shown coupled to a local data 
source, illustratively shown as a computer 140. It should be noted that fbs scope of the 
present invention is not mlended to be limited to the illustrative data sources shown in HG. 
1. since any data source may suffice for operation m accordance with the present invention. 
For example, the data source could readUy be any data source such as an optical storage 
device, a fixed disk storage device, a solid-state storage device, etc. 
Further, the data input 1 10 should be understood to accommodate any means for 
operatively couplmg the camera 120 with a data source. For example, the data input 110 
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may include an Ethernet interfece for coupling to a data source through either a wired or 
wireless Ethernet connection. Other means of coupling ate also known such as a Universal 
Serial Bus (USB) coupling, a wireless 802.1 1 coupling, a BlueTooth coupling, a Wi-Fi 
(Wireless Fidelity) coupling, etc. Any of these or other coupling systems may be suitably 
utilized in accordance with the present invention. The data input should also be 
understood to encompass local removable storage media, such as Compact Flash media, 
Secure Digital Multimedia Caids, etc. 

In accordance with an embodiment of the present invention, the camera 120 may 
also capture and/or determine additional data thiougji the use of at least one of the data 
input 1 10, the memory 126, flie mike 128, and/or the GPS receiver 124. The additional 
data is stored at some time in the memory 126 in a memory location associated with 
acquired unage data. The additional data is above and beyond the laW GPS coordinate 
data supplied by the GPS receiver 124. The additional data is intended to provide a user 
with, for example, enhanced location information that is meanmgfal in assisting the user to 
recall details of where image data is acquired. ITiis additional data is then retrieved by the 
user togetfier with the image data at some later time to, for example, act as a recaU aid so . 
that tiie user may later recall tiie significance of acquired image data. 

Further operation of fte present mvention will be described herein with regard to 
the illustrative system 100, shown in HO. 1. and witii regard to FIG. 2 tiiat shows a flow 
diagram 200 in accordance wifli an embodiment of tiie present invention. 
As illustrated, during act 205 timefiame and/or reference location data, iUustratively 
related to GPS coordinate data is received by fiie camera 120. The timefiame and/or 
reference location data may be stored in a portion of flie memory 126 for later use by the 
processor 122. In an embodiment where flie data iapat 1 10 accommodates a local storage 
media, the timeframe and/or reference location data maybe received from tiie local storage 
media. In tiie same or a further embodiment, tiie camera 120 may receive timefiame 
and/or reference location data from the Internet 130, flie computer 140, and/or any oflier 
external data storage device. 

In accordance witii an embodiment of tiie present invention, tiie timefiame and/or 
reference location data may be utilized by tiie camera 120 to provide a user wifli 
meaningful information (e.g., criteria) related to a GPS coordinate wherein content, such as 
an image, was acquired by die camera 120. For example, tiie reference location data may 
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correspond to a town and/or cily having a significant population density, such as a city 
having a population density over 100,000 people. It should be noted that population 
density equal to or greater than any number may, in some embodiments, not be the criteria 
utilized to determine what is significant criteria to a given user. However, a location with a 
large population density (e.g., >100,000 people) may be more likely to be significant 
criteria to a user than a location wifti a small population density. 

Other criteria that may be significant criteria to a user may include, for example, 
the place of birth of the user or other people known to the user. Significant criteria may 
also be a residence of the user or other people known to the user. O&er characteristics of a 
location that may render that location as significant criteria to a user would be readily 
apparent to a person of ordinary skill in the art and may also be criteria utilized in 
accordance with the present invention. Accordingly, any of these other criteria should be 
understood to be within fbe scope of the present invention. 

In an embodiment wherein fbs criteria includes personal information of a user, the 
15 data input 1 10 may be a computer mouse mput, a keyboard mput, or otherknown input 
particnlariy suited to fecilitate the user directly inputting the personal information. 
In accordance with the present invention, fbs processor 122 may have the ability to 
determine reference location data corresponding to, or in close proximity with GPS 
coordinate data determined fi»m the GPS receiver 124 or determined from anothe^ source 
of coordinate data coupled through the data input 1 10. The timeframe and/or reference 
location data may also be utilized to identify other significant characteristics, such as 
criteria related to ima^ acquisition as described further herein below. 

During act 210, the camera 120 acquires an image. Additionally, the processor 122 
may receive time of image, acquisition data and GPS coordinate data, from the GPS 
receiver 124. The GPS coordinate data may identify the location of where the image was 
acquired. During act 220, tiie processor 122 stores the GPS coordinate data, time of image 
acquisition data, and image data, corresponding to the acquired image, in the memory 126. 
It should be noted that tiie processor 122 may be utilized as a time keeping device to 
detemiine the time of image acquisition data or a separate time keeping device, such as the 
36 OJ^ receiver 124, or otiier not shown, may be contained within the camera 120 for 
determining die time of image acquisition data. The processor 122, utilizing a time 



20 



25 



5 



NL021389 to««-fr«Sdi±±a.3ib. « JiLS.1L iCiHSl 



keeping device, captures the current time at the time of image acquisition to determine the 
time of image acquisition data. 

FIG. 3 shows a portion 300 of the memory 126, for storing data related to an image 
that is acquired in accordance with the present invention. As shown, the portion 300 
5 comprises a portion 310 for storing image data, a portion 320 for storing the GPS 

coordinate data, a portion 330 for storing the time of image acquisition data, and a portion 
340 for storing additional data. The additional data will be described further herein below. 
In accordance with the present invention, flie act 220 may be repeated one or more times 
fliereafter and any additional data acquired will be sunilarly stored in the memory 126 

1 0 resulting in additional memory portions 300. 

During act 230, the processor 122 queries the one or more memory portions 300 for 
the GPS coordinate data and/or flxe time of image acquisition data corresponding to the 
image data acquired during act or acts 220. Utilizing the timeframe and/or reference 
location data, additional data corresponding to criteria, such as characteristics of particular 

15 interest, are determined by tiie processor 122 and are stored in the portion or portions 340 
for each of the images acquired. 

For example, in one embodiment, flie timeframe data may relate to an interval of 
time, such as a one-day interval. In accordance with one embodiment of the present 
invention, the processor 122 determines reference location data at a beginning and end of 

20 the one-day interral. The reference location data may correspond to where the camera 120 
is located, or located close to (e.g., a location wifli a high population density), at tiie 
beginning and end of the one-day interval. In this embodiment, after determining where 
the camera 120 is located at the beginning and end of one or more one-day intervals, the 
processor 122 queries the one or more memory portions 330 to identify unages acquired 

2 5 during each of the one or more one-day intervals. When an image is identified that was 

acquired during a given one-day interval, flie corresponding locations of flie camera 120 at 
the beginning and end of flie one-day interval are stored in the portion 340 as flie additional 
data for that image. In tins way, when flie processor 122 is utilized to retrieve flie data 
stored in image portion 300 during act 240, flie additional data stored in flie portion 340 is 

3 0 also retrieved. Inventively, this system 100 enables a user to retrieve flie additional data 

for each acquired image fliat oftentimes may be more significant criteria to the user then 
merely the location where the image was acquired. 
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Oftentimes, images are acquired when the user is traveling tfiroughout the course of 
the day. A given location where an image is acquired may be no more than some 
interesting stop along the way. However, sometime thereafter, it may be difficult to 
determine how each of the acquired images relates to a past event or trip. The present 
5 invention solves this problem by determining additional data for each acquired image. The 
additional data relates to criteria other than just the time and location of image acquisition 
and thereby may provide the user with further cues to help remember the significance of 
each acquired image. ' 

For example, for a user taking a day trip from New York City to Niagara Falls, the 

1 0 user may stop at a lake along the way that is an appealing spot to acquire an image. The 
exact location of the spot may have no significance to the user. However, the additional 
data fliat the spot is located between New York City and Niagara Falls (e.g., the beginning 
and end location of the camera 120 during a given one-day interval) may be fundamental 
criteria in aiding the user to recall how the acquired image relates to the user. After all, 

1 5 oftentimes it is not just the composition of the acquired image that is significant to the user. 
An acquked image may only be significant to the user if the user has the ability to recall 
how the acquired image relates to flie user. Yet, many times a user does not have tiiis 
ability utilizmg prior art image acquisition systems because the unage itself and even 
additional data such as time of image acquisition and location of image acquisition, is not 

2 0 significant to the user sometime after image acquisition. In this embodiment, it should be 

clear that the data input 1 10 need not be separate from tiie processor 122, the memory 126, 
and/or the GPS receiver 124 since Ae timeframe and/or reference location data may be 
derived from each or either of these devices. 

Inventively, the present system provides the user with additional data that assists 
25 the user in determining the significance of acquned images. The additional data, 

determined from the received timeframe and/or location coordinate data, is stored with the 
acquired image data and is retrieved by the user, when the image data is retrieved. 

As anoflier example, image data may be acquired over the course of a one or more 
day trip while traveling from the users place of residence to a user's parent's place of 

3 0 residence. Again, the significance of the image data may be its relation to the trip itself, as 

opposed to the location of where the image data was acquired. In this case, some of the 
additional data may be the location at which the trip started and the locations significance 
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to the user. This data may be detennined at the begiiimng of the trip via the GPS receiver 
124. 

Further, the additional data may be determined ftom other sources such as the mike 
128. In this embodiment; the processor 122 may receive audio input from the mike 128 
and thereafter, may convert the audio input to speech via speech recognition. The 
recognized speech may then be utilized to determine reference location data utilized in 
accordance with the present invention. For example, the user may activate the mike 128 to 
c^ture speech fiom fee user stating, "I am on nqr way to my mom's house." This speech 
is analyzed by the processor 122 to detemiine reference location data fliat mdicates the 
significance of any images acquired during the tap to mom's house. Thereafter, the GPS 
coordinate data of images Ibat are acquired is analyzed to determine if the hnages are 
acquhed along this route (e.g., on fbe way to mom's house). When the images are acquired 
along this route, flie additional data stored along with the images is data identifying that the 
images were acquired on the way to mom's house. 

The images may be acquired before or after the reference location data is provided 
to the camera 120. For example, vdien the reference location data is a beginning and 
ending location, the images may be acquired prior to ttie processor 122 determining the 
ending location. The processor 122 may store the beginning location with the acquired 
nnages and may at some time later, store the ending location with the same acquired 
images. Additional criteria for identifymg significant locations (e.g., locations with a high 
population density or tourist attractions) may not be. determined till some time later after 
the camera 120 is connected to a data source via the data mput 110. In any event 
whenever the camera 120 acquires other related data, such as reference location data, the 
processor 122 may store fliis related data as additional data witti tiie associated acquired 
images. 

The processor 122 may also utilize logic for identifying other additional data. For 
example, the processor 122 may utiMze the speech data "I am on my way to my mom's 
house" to determine additional data for images acquired around mom's house, in a given 
time frame (e.g., around the time frame of tiie trip). The additional data may be "tiie 
images where acquired during the tap to mom's house ftom this date (e.g., a start date) to 
that date (e.g., an end date)." 
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In another embodiment, Ae processor 122 may determine a location of the camera 
at the end of a day. and thereafter detemiine if the location at a following day is the same 
thereby indicating a stop over location. The indication of a location that is a stop over 
location may also be thereafter stored as additional data in the memory portion 340 for 
images that are acquired in a time or location proximity to the stop over location 

In yet another embodiment, a device in accordance with the present invention may 
operate to generate a trip description. During the trip, the time of image acquisition and 
the location of image acquisition is stored. D«1ng or after the trip, the location of image 
acquisition may be tmnslated to a more understandable description like road numbers 
towns, etc.. and saved as the additional data. . In tiris way. fte acquired images taken 
along a given route may be stored, with the given route saved as the additional data. 

It should be understood by a person of ordinary skill in tiie art that flie sequence of 
acts shown in FIG. 2 is not intended as a limitation to the appended claims. Specifically 
any other sequence of flie illustrated acts may be constructed that still would operate in ' 
accordance with tire present invention. For example, in one embodiment, all the image 
data including time of image acquisition and/or location of image acquisition may be 
acquired prior to the camera 120 receiving any timeframe data and/or reference location 
data. Further, even tire timeframe data may be received at a later time or ftom a separate 
source than the reference location data. 

Finally, the above-discussion is intended to be merely illustrative of flie present 
invention and should not be constmed as limiting the appended claims to any particular 
embodiment or group of embodiments. For example, ofl^r criteria would readily occur to 
a person of ordinary skill in the art and should be construed to be wifliin the scope of the 
present invention. Further, multiple criteria may be stored for one or more of the acquired 
maages as the additional data for Uie acquired images. The processor may be a dedicated 
processor for performing in accordance witii tire present invention or may be a general- 
purpose processor wherein only one of many functions operates for performing in 
accordance with the present invention. The processor may operate utilizmg a program 
portion, multiple program segments, or may be a hardware device utilizing a dedicated or 
multi-purpose integrated circuit. The memory 126 may be comprised of one or more solid- 
state memories, one or more optical memories, or any other combinations of known 
memory devices. Thecamera 1 20 may capture one or more images at tiie time of image 
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acquisition. Accordingly, the camera may be a motion picture camera, such as a 
camcorder. Additionally, other self-generated content may also be provided wifli the 
additional data in accordance with file present invention. Other self-generated content may 
also include audio content (e.g., sound recordings). Accordingly, the term camera, as 
utilized herein, should be understood to encompass other devices for acquiring self- 
generated content. The devices embodied in HG. 1 may actually be one or more separate 
devices. For example, the processor 122 GPS receiver 124, data input 1 10, memory 126, 
etc. may be embodied in a single device. In this or another embodiment, thneftame data 
and/or reference location data and the thne of image acquisition and/or location of image 
acquisition may be acquked ftom a single device having a timing portion and/or a 
positioning portion. 

Furflier, flie term GPS receiver, such as GPS receiver 124, is intended to 
incorporate ottier devices and systems known that can determuie a current position. For 
example, other devices may include a ceUular transmitter within a cellular telephone 
network. The network may determine the position of the ceUular transmitter and 
thereafter, transmit this location data to the camera 120. Accordingly, the location data 
may not need be determined by the camera 120. but may be deteimined external to the 
camera. In fact, the location data may be determined external to the camera and may be 
maintained external to the camera. In this embodiment, or other embodiments, such as 
those discussed above, the additional data may be determined external to the camera 120. 
The additional data may be transmitted to the camera 120 for storage in a memory, such as 
memory 126, or an external memory. In an embodiment wherein an externa! memory is 
utilized, the image data may thereafter be stored fai Ae external memory together with flie 
additional data. 

Numerous alternate embodiments may be devised by those having ordinary skUl in 
die art without departing from the spirit and scope of the appended claims. 
In interpreting the appended claims, it should be understood that 

a) the word "comprising" does not exclude the presence of other elements or 
acts than those listed in a given claim; 

b) the word "a" or "an" preceding an element does not exclude flie presence of 
a plurality of such elements; 

c) any reference signs in the claims do not limit their scope; 
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d) seveml "means" may be represented by the same item or hardware or 
software implemented structure or function; 

e) each of flie disclosed elements may be comprised of hardware portions (e.g., 
discrete electronic circuitry), software portions (e.g., computer programming), or any 
combination thereof; 

f) any of the disclosed devices or portions thereof may be combined together 
or separated into fiuther portions unless specifically stated otherwise; and 

g) no specific sequence of acts is intended to be required unless specifically 
indicated. 
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CLAIMS: 

1 . A content acquiring device comprising: 

a content input configured for acquiring content and at least one of a time of 
acquiring the content and a location of acquiring the content; and 

a processor operatively coupled to tiie content input and the data input, wherein ttie 
processor is configured to determine additional data firom a relation between at least one of 
the time of acquiring the content and the location of acquiring the content, and at least one 
of timefirame data and reference location data. 

2. The content acquiring device of Claim 1, wherein the content acquiring device is an 
imaging camera. 

3. The content acquiring device of Claim 1 , comprising a global positioning system 
receiver (GPS) wherein the GPS is configured to provide the processor with the location of 
acquiring the content. 

4. The content acquiring device of Claim 1 , wherein the content acquiring device is 
configured to receive both the timefiame data and the reference location data and wherein 
the timefirame data is a start and an end of a time interval and the reference location data is 
a location of the content acquiring device at the start and the end of the time interval. 

5. The content acquiring device of Claim i; wherein the content acquiring device 
comprises a memory, wherein the memory is configured to store the acquired content and 
the determined additional data. 

6. The content acquiring device of Claim 1 , comprising an audio input configured to 
receive at least one of the timeframe data and the reference location data. 
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7. The content acquiring device of Claim 6, wherein the processor is configuied to 
receive audio data fiom the audio input and to convert the audio input to at least one of the 
timeframe data and the reference location data. 

8. The content acquiring device of Claim 1, wherein at least one of the timeframe data 
and the reference location data is received from a network connection. 

9. The content acquiring device of Claim 8, wherein the network connection is 
configured to receive the least one of the tuneframe data and reference location data from 
an external content storage device. 

10. A method of acquiring self-generated content^ flie method comprising the acts oft 
acquiring content; 

acquiring at least one of a time of acquiring the content and a location of acquiring 
the content; 

receiving at least one of timeframe data and reference locatiop data; and 
determining additional data from a relation hetween at least one of the time of acquiring 
the content and the location of acquiring the content, and at least one of the timeframe data 
and the reference location data. 

1 1 . The method of Claim 1 0, wherein the acquired content is imaging content. 

12. The method of Claim 10, wherein both the timeframe data and the inference 
location data is acquired.. 

13. The method of Claim 12, wherein the timeframe data is a start and an end of a time 
interval. 

1 4. The method of Claim 1 2, wherein the reference location data is a location of the 
content acquiring device at the start and the end of the time interval. 
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15. The method of Claim 10, fiirflier comprising the acte of: 
receiving audio input; and 

converting the audio input to at least one of the timeframe data and the reference location 
data. 



1 6. A content acquiring device comprising: 

a content input configured for acquiring content and at least one of a time of 
acquiring the content and a location of acquiring the content; 

a data input configured to receive at least one of ttmefi^ame data and 
reference location data; and 

a processor operatively coupled to the content input and the data input, 
wherein the processor is configured to determine additional data from a relation 
between at least one of the time of acquiring the content and the location of 
acquiring the content, and at least one of the timeframe data and the reference 
location data. 



IS 



IS 



17. The content acquiring device of Claim 16, wherein the content acquiring device 
configured to receive both the timefiame data and the reference location data and wheiein 
the timeframe data is a start and an end of a tune interval and the reference location data 
a location of the content acquiring device at the start and the end of the time interval. 

1 8. The content acquiring device of Claim 16, comprising a position deteimining 
system wherein the position determining system is configured to provide the processor 
with the location of acquiring tiie content 



1 9. The content acquiring device of Claim 1 8, wherein the GPS is configured to 
provide the processor with tiie reference location data. 
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ABSTRACT 

A system and device for acquiring self-generated content and detennining 
additional data related to the self-generated content. The content acquiring device (120) 
may have a content input, a data input (1 10), and a processor (122). The data input (1 10) 
5 acquires content, a time of acquiring the content and/or a location of acquiring the content 
The data input (1 10) receives at least one of timefiame data and reference location data. 
The processor (122) is operatively coupled to the content iapat and the data input (110) 
and is utilized to determine additional data fixmi a rehrtion between at least one of the time 
of acquiring the content and the location of acquiring the content, and at least one of the 
1 0 timefiame data and fbe reference location data. 
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